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- Abstract 

o ■ 

^ ■ Let F be a p-adic field, and G„ one of the groups GL(n, F), GSO{2n-l,F), GSp{2n,F), 

or GSO{2{n—l), F). Using tfie mirabolic subgroup or analogues of it, and related "derivative" 
^'' functors, we give an asymptotic expansion of functions in the Whittaker model of generic 

representations of Gn , with respect to a minimal set of characters of subgroups of the maximal 
torus. Denoting by Z„ the center of G„, and by Nn the unipotent radical of its standard 
Borel subgroup, we characterize generic representations occurring in L'^{Z„N„\Gn) in terms 

rf^ [ of these characters. 

This is related to a conjecture of Lapid and Mao for general split groups, asserting that the 
generic representations occurring in L'^{ZnNn\Gn) are the generic discrete series; we prove 

P^ , it for the group G„. 
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Introduction 



Let Gn be the points of one of the groups GL{n), GSO{2n-l), GSp{2n), or GSO{2{n-l)) over 
a p-adic field K. The main result (Theorem l2.ip of this work describes the asymptotic behaviour 
of the restriction of Whittaker functions to the standard maximal torus, in terms of a family of 
^ i characters which is minimal in some sense. From results of |L-M| . this restriction can be described 

^\ ' for split reductive groups in terms of cuspidal exponents. 

CN ■ Here, after having defined analogues of the mirabolic subgroup for the groups G„, and the corre- 

^O ' sponding derivative functors, following [C-Pj (where the case of completely reducible derivatives 

is treated for GL{n)), we choose to describe the restriction of Whittaker functions to the torus 

'^ ' in terms of central exponents of the derivatives. 



This description, inspired by [B], is better adapted to understanding when the Whittaker model 
of a unitary generic representation is a subspace of L'^{ZnNn\Gn) (these representations are con- 
jectured to be generic discrete series by Lapid and Mao). 

In the first section, we review the groups in question and define their mirabolic subgroups. We 
^^ . also give a decomposition of the unipotent radical of the standard Borel subgroup, and a descrip- 

^ ' tion of how nondegenerate characters of this radical behave with respect to this decomposition. 

In Section 2, we give properties of the derivative functors, and use them to prove our asymptotic 
expansion of Whittaker functions, which is Theorem l2.1l 

In Section 3, we characterize generic representations with Whittaker model included in L^(Z„Af„\G'„) 
in terms of central exponents of the derivatives, in Corollary 13. II We then prove in Theorem 13.21 
the conjecture 3.5 of [L-M] . 

1 Mirabolic subgroup and nondegenerate characters 

Let F be nonarchimedean local field, we denote by Op its ring of integer, and by ^p — 'Ujf^ f 
the maximal ideal of this ring, where wp is a uniformiser of F . 
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We give a list of groups, and describe some of their properties which will be used in the sequel: 

• Case A: 

The group Go is trivial, and for n > 1, the group Gn is GL{n,F). 

We consider the maximal torus of Gn consisting of diagonal matrices, it is isomorphic to 

(F*)'"-. 

For n > 2, the simple roots of this group can be chosen to be the characters 

ai{diag{xi,. . . ,x„)) = XiX~^\ 

for i between 1 and n — 1. 

The root subgroup Uai is given by matrices of the form /„ + xEi^i^i for x in F . 

Standard Levi subgroups of Gn are given by matrices of the form diag{ai, . . . , a^) where a^ 
belongs to GL{ni, F), with rii + • ■ • + 71,^ = n. We denote the preceding group by Mini, ...,11^)1 
and the corresponding standard parabolic subgroup is denoted by -P(ni....,nr): with unipo- 
tent radical C/(„i,...,„^)- 



For n > 2 we denote by [/„ the group C/(ri-i,i), of matrices of the form 
It is isomorphic to i^"~^. 
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For n > fc > 1, the group Gk embeds naturally in G„, and is given by matrices of the form 

diag{g,In-k)', we denote by Zk its center. 

We denote by P„ the mirabolic subgroup G„_i k C/„. 

• Case B: 

The group Go is trivial. 

For n > 2, the group G„ — GO{2n — 1, F) is the group of matrices g in GL{2n — 1, F) such 
that *gJg belongs to F*J. We call the multiplier of an element g in G„ the scalar ij,{g) such 
that *gJg is equal to n{g)J (one checks that for this group, the multiplier actually belongs 
to (F*)^), where J is the antidiagonal matrix of GL{2n — 1,F) with ones on the second 
diagonal. It is the direct product of S0{2n— 1, F) with F* , more precisely, of 5'0(2n — 1, F) 
and the group I{F*) of matrices I{t) = t/2ri-i for t in F*. 

The maximal torus of G„ is equal to the product of the torus of matrices of the form 
diag{x~]_i, . . . ,x^^, l,xi, . . . ,x„_i) with I{F*) and is isomorphic to (F*)". 
For n > 3, the simple roots of this group can be chosen to be the characters 

ai+i{diag{tx^^^, . . . ,tx^^,t,txi, . . . ,tx„_i)) = XiX^_^^ 

for i between 1 and n — 2, and ai{diag{tx^_^, . . . , tx^ , t, txi, . . . , tXn-i)) — x^ ■ 
The root subgroups Uai are given by matrices of the form 

diag{u, . . . , 1, u, 1, . . . , 1, u^ , 1, . . . , 1) 

for matrices u in the unipotent radical of the Borel of GL{2, F). 

For n > k > 1, the group Gk embeds naturally in G„, and is given by matrices of the form 

diag{fj,{g)Ik, g, In-k), where fj,{g) is the multiplier of the element g oiGk- 

Its center Zk is given by matrices of the form Zfe(i) — diag{t'^In-k, tl2k-i, In-k) for t in K* . 



For n > 1 , the standard Levi subgroups of G„ are given by matrices of the form 

diag{^i{gYa^\, ..., n{gya^^,g, ai, . . . , a^), 

where Ui belongs to GL{ni,F), '^a is the transpose of a with respect to the second diagonal, 
g belongs to Gm, with 2m — 1 + 2ni + • • • + 2nr = 2n — l. We denote the preceding group by 
-^(m;ni,....nr)j ^^'^ the Corresponding standard parabolic subgroup consisting of block upper 
triangular matrices is denoted by P{m;ni,...,nr)j with unipotent radical U(^m;ni....,nr)- 
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For n > 2 we denote by [/„ the group f7(„_i:i): of matrices of the form 
It is isomorphic to i7'2«-3 

For n > 2, we denote by P„ the "mirabolic" subgroup G„_i k C/„. 

• Case C: 

The group Go is trivial, the group Gi is F* . 

For n > 2, the group G„ = GSp{2{n - 1),F), where GSp{2{n - 1),F) is the group of 

W] 



matrices g in GL{2{n — 1),F) such that *gJg belongs to F*J, where J = 



-W 



and 



W is the antidiagonal matrix of GL{n — 1,-F) with ones on the second diagonal. It is the 
semi-direct product of Sp{2(n — 1), F) with F* , more precisely, of Sp{2n, F) and the group 
I{F*) of matrices I(t) = diag{tln-i,ln-i) for t in F* . 

The maximal torus of G„ is equal to the product of the torus of matrices of the form 
diag{x^^_i, . . . ,x^ ,xi, . . . , x„_i) with I{F*) and is isomorphic to (F*)"^ . 
The simple roots of this group are the characters Q!i_|_i((img(ix~ j^, . . . , ixj" , xi, . . . , x„_i)) = 
XiX~^i for i between 1 and n — 2, and ai{diag{tx~_i, . . . ,te^ ,xi, . . . ,x„_i)) — tx^ . 
For i less than n, the root subgroup Ua^ is given by matrices of the form 

diag{l, . . . ,l,u,l, . . . ,l,u^^,l, . . . ,1), 

for matrices u in the unipotent radical of the Borel of GL{2,F), whereas Ua„ is given by 
matrices diag{l, . . . , 1, u, 1, . . . , 1), for matrices u in the unipotent radical of the Borel of 
GL(2,F). 

For n > k > 2, the group Gk embeds naturally in G„, and is given by matrices of the form 
diag{fi{g)In^k, 9, In-k), where fi{g) is the multiplier of the element g oi Gk- Its center Zk 
is given by matrices of the form Zk{t) — diag{t'^In-k,tl2{k-i), In-k) for t in F*. The group 
Gi, which is equal to its center Zi, embeds as I(F*). 

For n > 1, the standard Levi subgroups of G„ are: 

— either matrices 

diag{^i{gYa:;\, . . . ,^i{gYa^'^ ,g, oi, . . . ,0^), 

where a^ belongs to GL{ni, F), g belongs to Gm with m > 2, with 2{m — 1) + 2ni + 
• • • + 2nr — 2{n — 1). We denote the preceding group by M(„.„j^ n^), and the corre- 
sponding standard parabolic subgroup consisting of block upper triangular matrices is 
denoted by P{m;ni,...,nr), with unipotent radical U(^„i;ni,...,nr)- 
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or the matrices 

zi.diag{a^^^, . . . , a^^, oi, . . . , Ur), 

with fli in GL{ni, F), 2ni + ■ • ■ + 2nr = 2(n — 1), and zi in Gi. 

1 

For n > 2, we denote by J7„ the group J7(„_i;i) , of matrices of the form 



For n > 3, it is an extension of i^^t" '^> by F, which is the Heisenberg group corresponding to 
the alternating bihnear form on i^2(«-2)^ gj^^^^ ^y (VKi, VF2) x (Fi, V2) ^ -T^2-V"i +^VKi.F2. 
It is a two steps nilpotent subgroup, with center equal to its derived subgroup, given by 
matrices with Vx — V2— 0, and the maximal abelian quotient V^^ of C/„ is F^("~^^. 
The group C/2 is the unipotent radical of the standard Borel of G2 — GSp{2, F) = GL{2, F), 
and is isomorphic to (F, +). 

For n > 2, we denote by P„ the "mirabolic" subgroup G„_i k J7„. 

• Case D: 

We denote by Go the trivial group. The group Gi is F* . 

For n > 2, the group G„ = GSO{2{n — 1),-F) is the group of matrices g in GL{2n,F) 
satisfying that *gJg belongs to F* J , where J is the antidiagonal matrix of GL(2n, F) with 
ones an the second diagonal. It is the semi-direct product of 50(2(n — 1), F) with the group 
I{F*), of the matrices I{t) =- diag{tln, In) for t in F* . 

The maximal torus of G„ is equal to the product of the torus of matrices of the form 

diag{x~_i, . . . , xj" , xi, . . . , x„_i) with I{F*) and is isomorphic to (i^*)". 

If n is 2, then G2 is the diagonal torus of GL{2, F). 

For n > 3, the simple roots of this group can be chosen to be the characters 

ai+i{diag{tx:^^j^, ... ,tx^'^ ,xi, ... ,Xn-i)) = aj^x^^^ 

for i between 1 and n — 2, and ai{diag{tx^^ , . . . ,txi ,xi, . . . ,x„)) — tx^ X2 . 
For i > 1, the root subgroup C/cti+i is given by matrices of the form 

dia5(l, . . . , 1, M, 1, . . . , 1, M"\ 1, . . . , 1) 

for matrices u in the unipotent radical of the Borel of GL{2,F), whereas [/„! is given by 

"1 ' y 



matrices diag{l, . . . , 1, w, 1, . . . , 1) for matrices u of the form 



1 -y 
1 
1 



with y in F. 



For n > k > 2, the group Gk embeds naturally in G„, and is given by matrices of the form 
diag{ij{g)In-k, g, In-k), where iJ,{g) is the multiplier of the element g oi Gk. For fc > 3, its 
center Zk is given by matrices of the form Zk{t) = diag{t^ln-kiil2(k-i)iln-k) for t in F* . 
We denote by Z2 the subgroup of the torus G2, given by matrices of the form 
Z2(t) =diag(tI„_2,l,t,I„-2) for t in F*. 
The group Gi which is equal to its center Zi, embeds as I{F*). 

The standard Levi subgroups of G„ are the following: 



— The groups given by matrices of the form 

diaginigfa:;'^, ..., fi{gYa^^,g, oi, . . . , a^), 

where a^ belongs to GL{ni, F), g belongs to Gm with ?Ti > 3, with 2(m — 1) + 2ni + 
■ ■ ■ + 2nr — 2{n — 1). We denote the preceding group by M(^.„j_ „^), and the cor- 
responding standard parabolic subgroup is denoted by P{m;ni,...,nr)y with unipotent 
radical C/(m;„i,...,„^). 

— The groups given by matrices of the form 

g2.diag(^a:;^, . . . /aj"\ 1, 1, ai, . . . , a^), 

with ai in GL{ni, F), 2ni + ■ • ■ + 2nr = 2{n — 2), and 52 in G2. 

— The groups given by matrices of the form 

zi.diag{^a^^, . . . /oj^ , oi, . . . ,0^), 

with ai in GL{ni, F), 2ni + ■ • ■ + 2nr = 2{n — 1), and zi in Gi. 

— The groups given by matrices of the form 

Z2.diag{'^a^^,. . . ,'^a^^,g,ai, . . . ,0^), 
where ai belongs to GL{ni,F), and g in GL{2{m — 1), F) is of the form 
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eGL{m-l,F), 
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with 2to, + 2ni + • ■ • + 2nr = 2n and Z2 in Z2. 
For n > 3 we denote by [/„ the subgroup Uin-i-.i) of Gn, of matrices of the form 

1 -T/ -WV/2 
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It is isomorphic to F^ 



For n > 3 denote by P„ the "mirabolic" subgroup G„_i K [/„• 
We denote by U2 the group Ua^ and by P2 the group Gi k U2- 

Lemma 1.1. We denote by Zi the center of Gi, except in case D when n = 2, where we denote 
by Z2 the subgroup diag{l,t) with t in F* 0/G2. In all cases, one checks that the maximal torus 
An of Gn is the direct product Z1.Z2 ■ ■ ■ Zn-i-Zn, and each Zi is isomorphic to F* . Moreover, 
the i-th root has the property that ai{zi . . . Zn) ~ Zi, in other words these coordinates parametrize 
the torus An such that simple roots become canonical projections. 



The unipotent radical Nn+i of the standard Borel subgroup of Gn+i is equal to U2 ■ ■ ■ Un+i- 
Let 6* be a nondegenerate character of A^„+i (i.e. that restricts non trivially to any of the simple 
root subgroups). We denote by 9i+i the character d^jj.^^, except in the case D, for i = 2. In this 
case C/3 = Ua-^ X t/aj, and we denote by ^3 the character 03(uaiMa2) = ^(i*q;2)- 
Because 6 is trivial on Uder, and according to the description of Uder in Theorem 4.1 of |B-H| . 
the character 9i^i must be trivial on every root subgroup C/q contained in C/^+i such that a is 
not simple, moreover for case D, n = 2, the character ^3 is trivial on Ua-^. 

Conversely, if a non trivial character 0j+i of Ui+i is trivial on every Ua C C/^i+i which is not simple, 
and if, in case D, n = 2, we impose in addition that 63 is trivial on [/m, then one checks that the 
normalizer of 0j+i in the mirabolic subgroup P^+i is PiUi-^-i. As the group U2 ■■■ Ui is Si subgroup 
of Pi, a family of non trivial characters 0j+i of t/^+i, trivial on every Ua C C/i+i except Ua-, 
defines a nondegenerate character of Nn+i = U2 ■ ■ ■ Un+i by 6{u2 ■ ■ ■ u„+i) = Y[i=i ^i+ii'^i+i)- 

Now we fix such a nondegenerate character 6, and write 9'^ for the character 62 ■ ■ -Ok of N^- 



2 Derivatives and Whittaker functions 

If G is an ^-group, we denote by Alg{G) the category of smooth complex G-modules. If (tt, V) 

belongs to Alg{G), H is a closed subgroup of G, and x is a character of H, we denote by V{H, x) 

the subspace of V generated by vectors of the form 7T{h)v — x(/i)f for h in H and v in V. This 

space is actually stable under the action of the subgroup Na{x) of the normalizer Ng{H) of H 

in G, which fixes %. 

We denote by Sh the positive character of Ng{H) such that if // is a right Haar measure on G, and 

A is the left translation of smooth functions with compact support on G, then //oA(ri^^) = (5/f (7i)/i 

for n in N. 

This gives the spaces V{H,x) and Vh,x = V/V{H,x) (that we simply denote by Vh when x is 

trivial) a structure of smooth A^(3(x) -modules. 

Notations being as in the first section, and for k be an integer between 2 and n we define the 
following functors: 



First we recall the definition of the Jacquet functors: 

Let P be a parabolic subgroup of G„, with Levi subgroup M, and unipotent radical U. 
We denote by Jp the functor from Alg{Gn) to Alg{M) such that, if (tt, V) is a smooth 
G„-module, we have Jp{V) = Vjj, and M acts on Jp{V) by JpTi{m){v + V{U,1)) — 
5u(m)-^''^TT{m)v + V{U,l). 

With the same notations, we denote by ip the functor from Alg{M) to Alg[Gn) such that, 
if p is a smooth Af -module, and p is the corresponding P-module obtained by inflation of 
p to P, then ip{p) is the G„-module indp^{p) where ind is the usual compact induction. 

The functor ^'g (denoted rukfik in section 1 of |B-Z.2| ) from Alg{Pk) to Alg{Pk-i) such 
that, if {tt,V) is a smooth Pfc-module, ^g V = Vu^,0k, and P^-i acts on ^g{V) by 



The functor $^ (denoted iuk,ek in section 1 of |B-Z.2| ) from Alg{Pk-i) to Alg{Pk) such 



that, for TT in Alg{Pk-i), one has $g n = indp ^ {SjJ tt (E) Ok), where ind is the usual 



compact induction. 

The functor <I>^ [lukfik in section 1 of |B-Z.2] ) from Alg{Pk-i) to Alg{Pk) such that, for n 
in Alg{Pk-i), one has $g tt — Indp'' ^ {Sj tt ® dk), where Ind is the usual induction. 



• The functor ^ is the Jacquet functor Jf/^, (denoted rjj^^i in section 1 of |B-Z.2) ) from 
Alg{Pk) to Alg{Gk-i), such that if (tt, V) is a smooth P^-module, ^^y = Vu^.,i, and Gfe_i 
acts on ^-{V) by *-^(5)(i;) + T/(f/fc,0fc) = SuA9)~^^Mp){y + V{Uk,l)). 

• The functor ^+ (denoted iuk-i iii section 1 of |B-Z.2| ) from Alg{Gk^i) to Alg{Pk), such 
that for TT in ylZ(jr(Gfc-i), one has ^+7r = indj' _ u ,{^u '"' ^ 1) = ^jj . tt ® 1. 



As we aheady fixed the character 9 of Nn, we will most of the time forget the dependence in 
0k of ^g and $^ , and we will write these functors $~ and $+. These functors have the following 
properties which follow (except for c) an d) which are trivial) from Proposition 1.9 of [B-Z.2) : 



Proposition 2.1. a) The functors ^^ , $+, ^^, and ^+ are exact. 

b) vp" is left adjoint to *+. 
b') <i>~ is left adjoint to $+. 

c) $-^+ = 

d) *-*+ =Id. 

Now we want to know how these functors restrict to smooth Pfc-modules which are submodules 
of the space C°°{Nk\Pk, d^) — Indj^ [9^) of functions on P^, fixed by some open subgroup of P^ 
under right translation, and which transform by 9^ under left translation by elements of N^ ■ 
The next proposition shows the stability of this type of modules under $~ and <&+. 

Proposition 2.2. For any suhmodule t ofC^{Nk\Pk; 9''), the Pk-i-module $^r is a submodule 
of C°°{Nk^i\Pk~i,9^^^), with model given by restriction of functions 5^ W in t to Pk^i, and 
such that we have '^^t(p)W — p{p)W for p in Pk-i, where p is the action by right translation. 
Conversely, the Pk+i-module ^'^t can be identified with a submodule of C°°{Nk+i\Pk+i,9''^^), 
with the natural action of Pk+i by right translation. 

Proof The first property will hold if we show that C°°{Nk\Pk,9'^){Uk,9k) is the kernel of the 
restriction map to C°°{Nk-i\Pk-i,9'^~^), this is a straightforward adaptation of the proof of 
Proposition 2.1 of jC-Pj . 
The second property is a consequence of the following equalities and inclusions: 

^+iC°-iNk\Pk,9^)) = znd';i^^\^^{5y^^^.Indll{9'^) ® 9k+i) 



Then 



5]Jljndl\{9'^)c,Ind^^-^{9^) 



1 /2 

because the character 5tI of Pj. is trivial on Nk- 

Uk + l '- '^ 

Finally 

/nd^^+;^^^(/n4';(0^-) ® 9k+i) ^ Ind';^^^^{9^+') 

D 

More can be said about smooth P/^-submodules of the space C°°{Nk\Pk, 9*^) = Indp^ [^'')- If 
T is a Pfe-submodule of C°°{Nk\Pk, 9^), then the derived subgroup of Uk (which is trivial except 
in case D) acts trivially. 

To see this, take W in C°°{Nk\Pk, 9^), we claim that if u belongs to the derived subgroup C/^'^'^ 
of Uk, then t{u)W and W are equal. So let p belong to P^; one has t{u)W{p) — W{pu) — 
Wipup'^^p) — 9*^ {pup^^)W {p) . But Pk normalizes Uk (so 9^{pup^^) = 9k{pup^^)), so that it 
normalizes its derived subgroup as well; as 9k is trivial on this subgroup, this proves our claim. 

For such modules Pi:-modules, there is a nice interpretation of V{Uk, 1) in terms of the ana- 
lytic behaviour of Whittaker functions. First, we make the following observation. 



Remark 2.1. For fc > 3, as a consequence of the Iwasawa decomposition, any element g of Gk-i 

can be written in the form pzc with p in Pk~i, z in Zfc-i, and k in K — G'fc_i(Di?), and the 

absolute value of z depends only on g, so we can write it \z{g)\F. 

If a function W is in the space oi C°°{Nk\Pk, d^), then for g in Gk-i, we show that W{g) vanishes 

whenever \z{g)\p is large enough. 

Indeed if we take the "natural" group isomorphism u from (F™,+) to U^^, for some positive 

integer m, and recalling that it is in fact U^^ that acts on V, then u{x) will fix W for x near zero 

inF'". 

But then, for g in Gk-i of the form pzk, one has W{g) — W{gu{x)) = dk{gu{x)g~^)W{g), 

which is equal 0k{zku{x)(cz)~^)W (g) because Pfc_i normalizes 0k- This implies the equality 

[9k{zku{x){kz)~^) — l]W{g) — [dk{u{zkx)) — l]W{g) = for any a; in a neighbourhood of zero 

depending only on W. The assertion follows easily. 

Proposition 2.3. Let {t,V) be a Pk-submodule of C^{Nk\Pk,0^). Then the space V{UkA) is 
the subspace of V , of functions W such that there exists an integer Nyy with W{g) = 0, for any 
g satisfying |2:(5)|f < Qf^"^ ■ 

Proof. Suppose first that a function W is in V{Uk, 1), so we can write it tt{u)W' — W for some 
u in U^^ and some W' in V. Then, writing g as pzk, and u as u{x) for x in F"^, we have 
[tt{u)W' — W']{g) = [dk{u{zkx)) — l]W'{g), which will be zero to when \z\f is close to zero. 
Conversely, we use the characterization of Jacquet and Langlands asserting that the elements W 
of V{Uk,l) — V{Uk^,l) are those such that Jjj T{u)Wdu is zero as soon as the open compact 
subgroup U of Uj^^ contains some compact open subgroup Uw- So suppose W is in V and that 
it vanishes on elements g of Gn-i{F) satisfying |z((7)|i? < q^ "'. 

Let U be any open compact subgroup of Uff" , that we identify with a subgroup of F"^ . The 
integral Jj^ T{u)Wdu evaluated ai g = pzk, is equal to /^^r/ 9k{zkx)W {g)dx . Hence this integral 
is always zero for \z\f < qp "" because W{g) is. 

We now recall that as Ok is a non trivial character of [/^^, there exists a compact open ball C/q of 
jjab r-j pn gm^j^ that, the integral J^ jj6k{x)dx is zero whenever the compact open subgroup U 

of U^^ contains Uq- But then ior \z\f > Qp ^ , H tw is an element of F* of absolute value qp^ , 
the integral J^ jj6k{zkx)W{g)dx is also zero as soon as U contains tiyt/o- Hence JjjT{u)Wdu 
is zero when [/ is a compact open subgroup of U^^ containing Uw — twUo, and W belongs to 

ViUk,l). 

a 

For any smooth P„-module r, and any integer k > 1, we denote by T(^k) the representation of 
Pn-k+i equal to $'^~^t, and by r^*^^ the representation of Gn-k equal to vI'^$'^^1t ~ $^r(fc). 
We say that a smooth irreducible representation tt of G„ is ^"-generic if it is isomorphic to a 
submodule of the induced representation Ind^" (tt). If it is the case, the submodule of Ind"^" (tt) 
isomorphic to tt is unique, it is called the Whittaker model of tt and denoted by W{Tr, 6*"). 
Now we let (tt, V) be a ^"-generic representation of G„ (hence a smooth P„-module as well), we 
denote by (tt', V) the representation of P„ obtained on the space of restrictions of functions in 
W{tt,9) to Pn, it is a quotient of tt as a P„-module, and restriction to P„ is known to be an 
isomorphism in case A. 

The following proposition follows from applying repeatedly Proposition 12. 2L and from Propo- 
sition 12.31 

Proposition 2.4. Let t be a smooth Pn-submodule o/ C°°(A^„\P„, 0"), and k > be an integer, 
then the Pk+i-module T(^n~k-i) is a submodule of C°° {Nk+i\Pk+i , S'^'^^) , with model given by re- 
striction of functions [Su^^^ ■ ■ ■ ^u,^]^^ W in t to Pk+i- In this realisation, one has T(^n-k~i){p)W = 
p{p)W for p in Pk+i, where p is the action by right translation. 



The next proposition asserts amongst other things that for every fc > 1, the Gn-fe-module 
TT^'^^ has finite length. 

Proposition 2.5. // (tt, V^) is a smooth representation of Gn of finite length, then for k between 
1 and n — 1, the Gk-module tt'"^'''-' (hence its quotient 7r'("^'^)J has finite length. 

Proof. For fc > 1, except in case D, fc = 2, we denote by Uk,n-k the unique standard unipotent 
radical (denoted by Utk-n-k) iii the previous section) containing Ua^ as only simple root subgroup. 
In case D, for fc = 2, we be denote U2,n~2 the unique standard unipotent radical containing Ua-^ 
and Ua:2 a-s only simple root subgroups. 

In all cases, the corresponding Levi Mk,n-k is the direct product of Gk with GL{n — k,F). 
Now the module G^-module tt^""*^) is a quotient of the Jacquet Gk x GL(n — fc)-module 

{7ru,^„_,,V/V{Uk,n-kA)), 

as the kernel of the surjective map n -^ 7r("~'^) contains V{Uk,n-k, !)• More precisely, let Nn^k.A 
be the unipotent radical of the standard Borel subgroup of GL{n — fc, F), the group Uk+i ■ . -Un 
is the semidirect product Nn-k,A x Uk.n-k, so that the space V^("^'^) of tt^"^'^-' is equal to the 
quotient 



V/V{Nn-k,A K Uk,n-k.e?j, _, , «> 1 



Uk.^-k 



where V is the space of tt. 

We denote by Ik the surjection obtained by facorisation from Vc/j. „_^ onto y (""*-'). From Lemma 

2.32 of |B-Z| . the map Ik identifies with the projection 

V;7fc,„_fc -» (V;7fe,„- jAr„_fc,A,ep„_^_^^ ^ = yUk,^-klVUk,^-k{^n-k,A,d](j^^_^^^). 

The map Ik is in fact a Gfe-modules morphism, because of the equality of modulus characters 

{^Uk.^-k)\Gk = i^Uk + i •■•^(7„)|Gfc 

which is itself a consequence of the decomposition 



Uk,n-k = n iUk,n-k n C/,; 



i=k+l 

The group NA.n-k being a union of compact subgroups, the map Ik preserves exact sequences. 
As the Jacquet module functor preserves finite length, the Gk x GL{n — fc, i^)-module ttjj^ ^ ,, 

has a finite composition series C (7r[/^ „-k)i '^ ' ' ' "^ i'^Uk n-k)rk — '^Uk n-k- We put tt^ — 

h[{TrUk,„^k)i]- 

Hence tt, ' /tt^'^^'' i^ equal to [{'n-Uk,^-k)t/i'^Uk,^-k)t-i]N„^k.A,SiN„_^ ^^ but as a Gfc x GL{n - 
fc, i^)-module, the quotient (tt^/j. „_^)i/{'^Uk „_fc)i~i isomorphic to pi ®p2 for irreducible represen- 
tations pi and p2 of Gk and GL{n~k, F) respectively. Because the character 6*" restricts to Nn-k.A 
as a nondegenerate character, the quotient TTj /7''i"i is equal to pi(>5(/92)Ar„_fc ^.e™ , thus 

it is zero unless p2 is generic, in which case it is equal to the irreducible representation pi. 
So we proved that tt'^""'^) has finite length as G^-module, smaller than the length of the Jacquet 
module Trjjf, ^_^ as a Gk x GL{n — fc, F)-module. 

□ 

There is another property of the maps Ik defined in the proof of the preceding proposition 
that is worth mentioning, which is that their restriction to generalised characteristic subspaces is 
nonzero. More formally, let G be an Z-group, and T be a closed abelian subgroup of G. If y is a 
smooth G-module, following jC], we define for each character x of T, the T-submodule 

V^x.oo = {vGV\3ne N,Vt e T, {T{t) - x{t)Idriv) = 0}. 



If V is T-finite (i.e. every vector in V generates a finite dimensional T-module), then it is the 
finite direct sum of its (nonzero by definition) generahsed characteristic subspaces, and every such 
(nonzero) V^^oo contains the nonzero generalised eigenspace 

V^^{ve V\ 3n eN.yte T, {T{t) - x{t)Id){v) = 0}. 

First recall that smooth (F*)''-modules E, with a filtration = i?o C i?i C • • ■ C Er-i C 
Er = E such that (F*)*" acts by a character on each quotient are (_F*)''-finite. 

Lemma 2.1. Let E be a smooth {F*Y -module E, with a filtration ^ Eq C Ei C ■ ■ ■ C E^-i C 
Er — E such that (^F*Y acts by a character q+i on each quotient Ei-^-i/ Ei, then any vector of E 
lies in a finite dimensional [F*]''' -submodule. 

Proof. One proves this by induction on the smallest i such that Ei contains v. If this i is I, the 
group {^F*Y only multiplies z; by a scalar, and we are done. 

Suppose that the result is known for Ei, and take v in -E^+i but not in Ei. Then for every t in 
(F)*, the vector T{t)v — Ci+i{t)v belongs to Ei. By smoothness, the set {t{u)v \t € {UfY} is 
actually equal to {t{u)v \u G P} for P a finite set of {UfY ■ The vector space generated by this 
set is stabilized by {UfY i ^^^ has a finite basis wi, . . . , Vm- Now the vectors 

t(1,.. .,l,n7F,l,.. .,l)f/ - c.j+i(l,. ..,l,n7F,l,.. .,!)«/ 

belong to Ei, hence by induction hypothesis, to a finite dimensional (F*)''-submodule Vi of Ei. 
Finally the finite dimensional space Vect{vi, . . . , Vm) + Vi + ■ • • + Vm is stable under {UfY ^^^^ 
the elements (1, . . . , 1, wf, 1, ■ ■ • , 1), hence {F*Y , and contains v. D 

This in particular applies to the ZkZn-modu\e Vjjt. „_fe and the Z^-module V described in the 
proof of Proposition 12.51 as both are respectively Gk x GL{n — k,F) and Gfc-modules of finite 
length. 

Now we can prove the following property of the maps Ik : 

Proposition 2.6. Let (tt, V) be a 6^^ -generic representation of Gn, and for fc > 1, let Uk,n-k o,nd 
Mk^n-k — Gk xGL{n — k, F) the subgroups of Gn defined in the vroof of Provosition \2.5[ Let x be a 
character of the central subgroup Z^Zn of Mk^n-k, o,nd denote by the same letter its restriction to 
the central subgroup Zk of Gk. If the generalised characteristic subspace {Vu^ ^_Y)x.oo is nonzero, 

then the map Ik restricts non trivially to {Vu,^ „-k)x- -^"' pO'i^icular the space V^ is nonzero. 

Proof. Suppose that the subspace {Vu^. ,^_,k)x,oo of Vu^. ,,_j. is nonzero, hence {Vu^. ,^_k)x is nonzero. 
The space {Vu^, „_fc)x is Mfe_„_fe-submodule of Vuf, „_fc, so it has finite length, hence it contains 
some irreducible representation /9i(X)p2 of Mfc_„_fe. Hence iJoTT^Mfc „_fc(pi®P2j ^[/^ „_fc) is nonzero, 
but then from Bernstein's second adjointness theorem (see [BuJ, Theorem 3), we deduce that V 
is a quotient of the representation pi x p2 parabolically induced from pi ® p2- As V admits a 
nonzero Whittaker form, so does pi x p2, and from a classical result of Rodier (Theorem 7 of 
[R]). this implies that pi and p2 are generic with respect to some nondegenrate character. As 
generiticity doesn't depend on the character for GL{n — k,F), we deuce that Ik{pi <E) P2) = Pi- 
Hence Ik restricts non trivially to {Vu^_ „-k)x^ ''^^^'^ ^^^ image Ik[{Vij^ n-k)x\ contains pi which is 
a nonzero submodule of V^^ ■ CH 

We will also need to know that, if k is an integer between 1 and n— 1 and x is a character of Zk, 
then the Z^-modules {V'''^^^^)^ and {V''^'^~^^)x are nonzero at the same time. We already know 
from the previous proposition that this is equivalent to the fact that the Zi:-modules (F'^"^*'^)^ 
and {Vu^ n-k)x ^^^ nonzero at the same time, and that (F'^""*^))^ nonzero implies that {Vu^. „_fc)x 
is nonzero. 
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Proposition 2.7. If (ir^V) is a 9^ -generic representation of Gn, and for k>l, let Uk^n-k o-nd 
Mk^n-k — Gk X GL{n — k,F) be the subgroups of Gn defined in the proof of Proposition \K^ 
Let X be a character of the central subgroup ZkZn of Mk^n-k, o,nd denote by the same letter its 
restriction to the central subgroup Zk of Gk, then the space (Vu^. „_t.)x ^■s nonzero if and only if 
the space {V'^"'"''')^ is nonzero. 

Proof. We only need to prove that if {Vu^ „-k)x ^^ nonzero, then the space (y''-""'^')^ is nonzero. 
So suppose that the Mfc^„_fe-niodule {Vuf. „_fc)x i^ nonzero, it is of finite length, hence it contains an 
irreducible Mfe_„_fc-submodule p. Call Pk.n-k the parabolic subgroup Mk^n-kUk.n-k, and P^n-k 
its opposite parabolic subgroup (with unipotent radical {Uk.n-k)~)- We already saw that by 
Bernstein's second adjointness theorem, the induced representation i " {p) has tt as a quotient, 



and therefore z " (p) is ^"-generic. Then from Theorem 7 of pRJ, the Mfe_„_fe-module p is 9- 

generic, where 9 is the restriction of 6*" to the unipotent radical of the Borel oi M^^n-k- Both have 
the same Whittaker model W{Tr, 6*"), i.e. the (unique up to scalar) Whittaker form on the space of 
*p" (p) facorises through the projection from i^" (p) to n. Let L~ be a nonzero 6'- Whittaker 

form on the space of p, by Theorems 1.4 and 1.6 of |C-S| . there is a nonzero Whittaker form L on 
the space of z^" (p) whose restriction to the subspace C'^ {P^ ^_j}\Pf^ ^_f.Uk,n-k^ {^ij- Y^"^ p) of 



functions with support in P^ j^^jJJk.n-k is given by 



/^/ L-{f{u))9-Hu)du. 

JUk.^-k 

We denote by L the Whittaker form on the space of tt which lifts to L. In particular, for any / 
in the space of tt, which is the image of / in C"^ {Pf^ ^_j,\Pf^ ^_jJJk.n-k) : one has 



L(/) = / L-{f{u))9-'{u)du. 

JUk,^-k 

Let w be a vector in the space of p, such that L~{v) is nonzero. Let K' be a compact subgroup of 
G„, with Iwahori decomposition with respect to Pk^n-k, and such that K' D Mk^n-k fixes v, then 
the function a equal to u~mu i— >■ p{m)v on (Uk.n-k)~ Mk^n~kiUk.n~k H K'), and zero outside, 
is well defined and belongs to the space C'^{P^^_^\P^^_fJJk,n~kTP)- We denote by Wa the 
corresponding Whittaker function g i— >■ L{TT{g)a). If a belongs to the group Zk, one has 

Wo,{a) = / L- {a{ua))9-^ {u)du 

^x{a)Suli\{a) f L-{a{a-'ua))9-\u)du 

JUk,,^-k 



= xio^Sjj _ (a) L {a{u))9 {aua )du 

"'""" JUk,„-k 

= x{a)5\l^ _^{a)L-{v) [ 9-\aua-^)du 

In this last integral, u stays in the compact set Uk.n-k H K' , hence there is a (punctured) 
neighbourhood of zero in Lie{Zk) — F, such that a{Uk,n-k H K')a^^ is a subset of Ker{9) when 
a belongs to this neighbourhood. Finally, up to multiplication of the function a by a scalar, one 
has 

W^ia)^xia)Slj{l_^ia)L-iv) 

whenever a is this neighbourhood of zero. 
A similar computation gives the equality 

Wa{zg) = x{z)5uk^„_kizy^^^g 
11 



for z in Z-^, in a neighbourhood of zero and g in Gfc, where Cg is the constant J, 
Hence from Propositions 



Uk^ 



^u„, 



[/,„_, i {a{ug))du. 

and the equahty (5[/fc.„_J|Gfc = ('^c/^+i ■ • •'5;7„)|Gfc: we deduce 

^/^Wq, in the space of tt', , , ,^ is such that its image in tt'^"^*^^ 



that the vector {S, 

is nonzero and belongs to the space (tt''^"^*')^. This proves the proposition. 



'(n-fc+l) 



D 



A straightforward generahsation of the proof of the preceding proposition gives the fohowing 
corollary. 

Corollary 2.1. Let G be the F-points of a quasi-split reductive group defined over F. Let P be a 
parabolic subgroup of G with a Levi subgroup M , and P~ its opposite subgroup with PC\P~ = M . 
Let (tt, V) be a smooth 6-generic representation of G, for some nondegenerate character 9 of the 
unipotent radical U of a Borel subgroup of G contained in P. We denote by jp- be the map 
defined in Theorem 3.4 of JS from (V*)^" to (Jp{V)*)^'^'^^'' . If L is a nonzero vector of the 
line (V*)^" , then the linear form jp-{L) restricts non trivially to any irreducible M-submodule 
of Jp{V) whenever the Jacquet module Jp(V) is nonzero. 

We now come back to the study of F*-modules E with finite factor series such that F* acts by 
a character on each quotient. From Lemma |2. II any vector of E will belong to a finite dimensional 
F*-submodule E' as in: 

Proposition 2.8. If E' is a non zero finite dimensional F* -submodule of E, then E' has a basis 
B in which the action of F*r is given by a block diagonal matrix MatB{T{t)) with each block of 
the form: 

(c{t) c{t)Pi,2{vF{t)) c{t)Pi,3{vF{t)) ... c{t)Pi^q{vF{t)) \ 

C{t) c{t)P23{vF{t)) ... c{t)P2^q{vF{t)) 



V 



C(i) c(i)Pg-l,5(wFW) 

C{t) j 



for c one of the Ci 's, q a positive integer depending on the block, and the Pij 's being polynomials 
with no constant term of degree at most j — i. 

Proof. First we decompose E' as a direct sum under the action of the compact abelian group Up. 
Because E' has a filtration by the spaces E' Ci Ei, and that F* acts on each sub factor as one of 
the Ci's, the group Up acts on each weight space as the restriction of one of the c^'s. Now each 
weight space is stable under F* by commutativity, and so we can restrict ourselves to the case 
where E' is a weight-space of Up. 
Again E' has a filtration, such that F* acts on each sub factor as one of the c^ 's (with all these 



characters having the same restriction to Up), say Ci-^, . 



. , in particular, we deduce that the 



endomorphism t{wp) has a triangular matrix in a basis adapted to this filtration, with eigenvalues 
Cij (vup), . . . ,Ci^ {'ojf)- As t{'ujf) is trigonalisable, the space E' is the direct sum its characteristic 
subspaces, and again these characteristic subspaces are stable under F* . 

So finally one can assume that E' is a characteristic subspace for some eigenvalue c(7r) of t{wp), 
on which Up acts as the character c, where c is one of the Ci 's. 



Hence there is a basis B of E' such that 



MatB{c^'^{t)T{t)) 



(I Ai.2(t) Ai.3(t) 
1 ^2,3(0 



V 



... A2,,{t) 

1 / 



for any i in F* , where the Ai^j 's are smooth functions on F* . So we only have to prove that the 
Ai j's are polynomials of the valuation of F with no constant term. 
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We do this by induction on q. 

It is obvious when q — 1. Suppose the statement holds for q — 1, and suppose that E' is of dimen- 
sion g, with basis B = (vi, . . . ,Vq). Considering the two c~^T(_F'*)-modules Vect(vi, . . . ,Vq-i) 
and Vect{vi, . . . , Vq)/Vect{vi) of dimension q — 1, we deduce that for every couple {i, j) different 
from (l,g), there is a polynomial with no constant term Pij of degree at most j — i, such that 
Ai,j — Pij ovp. Now because c~^t is a representation of F*, and because the Pijovp's vanish on 
Up for {i,j) 7^ (1,9), we deduce that Ai^g is a smooth morphism from {Up, x) to (C, +), which 
must be zero because (C, +) has no nontrivial compact subgroups. From this we deduce that Ai^q 
is invariant under translation by elements of Up (i.e. Ai^g^iUpu) = Ai^q{zup) for every U in Up). 
Denote by M{k) the matrix Afats(c- V(w|.)) for k in Z. One has M{k) = M{l)M{k - 1) 
for fc > 1, which in implies Ai^g(tu^) = Y.'jZl Pi,j{'^)Pj.q{k ~ 1) + ^i,g(w^"^) + Ai^q{mp) = 
Q{k) + Ai^q{wp^^) + Ai^q{u7p) for Q a polynomial of degree at most q — 2. This in turn implies 
that Ai^q{wp) = J2i=i Q(0 + kAi^q{'UJp) = R{k) for R a polynomial of degree at most q — 1, 
according to the theory of Bernoulli polynomials, for any fc > 0. The same reasoning for fc < 0, 
implies Ai^q{'cjp) = R'{k) for R' a polynomial of degree at most g — 1, for any fc < 0. We need 
to show that R — R'io conclude. 

We know that M(fc) is a matrix whose coefHcients are polynomials in fc for fc > of degree at 
most g — 1, we denote it by P{k). The matrix M{k) has the same property for fc < 0, we denote 
it by P'(fc). Moreover for any fc > and fc' < 0, with fc + fc' > 0, one has P(fc + fc') = P(fc)F'(fc'). 
Fix k > q — 1, then the matrices P{k + fc') and P{k)P'{k') are equal for fc' in [1 — g,0], as their 
coefficients are polynomials in fc' with degree at most q — 1, the equality P{k + z') — P{k)P'{z') 
holds for any complex number z' . Now fix such a complex number z', the equality P(fc -f z') 
and P{k)P'{z') holds for any integer fc > q — 1, and as both matrices have coefficients which are 
polynomials in fc, this equality actually holds for any complex number z, so that P{z + z') equals 
P(z)P'{z') for any complex numbers z and z' . 
As P(0) — Iq, we deduce that P and P' are equal on C, and this implies that R is equal to R' . D 

From this we deduce the following theorem, giving an expansion at infinity of Whittaker 
functions of generic representations of G„, for GL{n), the statement holds for ant smooth P„- 
submodule of finite length of C°°(Af„\P„): 

Theorem 2.1. Let 9 be a nondegenerate character of the group Nn, let tt be a 9-generic repre- 
sentation of Gn, and let ci_„_fc, . . . , c^^.n-fc be the characters of Zk appearing in a composition 
series of t = tt^"^^^' . Then, for any function W in the space of tt, the function 

W{zi,Z2, ..., Zn^i) = W{ziZ2, -Zn^l) 

is a linear combination of functions of the form 



n [c.„fc4l+, ■ • ■ Slji\zk)vpizkr^M^k) 



fe=l 



for ik between 1 and r^, positive integers nik, and functions (j)k in C^{F). 

Proof. Actually we prove the following stronger statement, which is satisfied by 7r(o) according to 
Proposition [ 



. LetTT be a suhmodule ofC°°{Nn\Pn,9), such that for every k betweenl andn--!, the Gk-module 
T = tt'-""*'') = ^~($~)"~'^~^(7r) has a composition series such that on each respective quotient, 
the central subgroup Zk acts by the characters ci_„_fe, . . . ,Cr^.n-k- 

Then, for any function W in the space of it, the function W{zi,Z2, ...,z„_i) = W{ziZ2, ...Zn-i) 
is a linear combination of functions of the form 



nt^'fc'fc'^c/1+i ■■■5u^]{zk)vp{zkT''(l)k{zk) 
fc=i 

for ik between 1 and r^, positive integers rUk, and functions (pk in C^{F). 
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The proof is by induction on n. 
Let W belong to the space of n. We denote by v its image in the space E of tt*^^^ . The vector v 
belongs to a finite dimensional Z„_i-submodule E' of E, on which Zn-i acts by a matrix of the 
form determined in Proposition l2.8l We fix a basis B — (ei, . . . , e^) oi E', and denote by M(o) the 
matrix AlB{T{a)) (with a in Z„_i and T{a) — TT^^'{a)), hence we have T{a)ei = X]fe=i M{a)k.iek 
for each I between 1 and q. 

/El' 

Taking preimages Ei, . . . , Eg of ei, . . . , Cg in 7r(o), we denote by E the function vector : 

If the image w of W^ in n^^^ is equal to a;iei + • • • + XqCq, there is an integer M, such that for 
every (zi, . . . , Zn-2) in Zi x • • • x Z„^2, the function 

Ty(zi,...,z„_i) - (xi,...,a;q)i?(zi,. ..,z„_i) 

vanishes for |2;„_i|i? < Qp^^ . We denote by 5 the function {xi, . . . ,Xq)E. 

Because of Remark 12.11 there is an integer M', such that for any (zi, . . . , Zn-2) in Zi x • ■ • x 
Zn~2: and any z„_i in Z„^i of absolute value greater than g^/ , both W(zi, . . . , z„_i) and 
S{zi, . . . , Zn-i) are zero, so that the difference D{zi, . . . , z„-i) of the two functions is a smooth 
function which vanishes whenever z„_i has absolute value outside [q^^ ,q^ ]■ Moreover there 
is a compact subgroup U of Z„_i(Di?) independent of (zi, . . . ,z„_i) such that both functions 
(hence D) are invariant when z„_i is multiplied by an element of U. Denoting by (zq,)^ g a a 
finite set of representatives for 

{z\qp^'<K-i\F<q'/}/U, 

this implies that _D(zi, . . . , z„_i) is equal to J2a e a -^(-^i' • • • ' ^"-2i ^a)lzct/(^n-i); which we 

can always write as J^a e a -^(^i' ■ • ■ ' ^"-2, 2;a)(5^ (z„-i)-Da(z„_i) with Da = S^^''^lz^u in 

Cr(^ie(Z„_i)). 

Each function D{zi, . . . , z„_2, -^q) is equal to W{zi, . . . , z^) — ^(zi, . . . , Zq), and the restrictions to 

— 1/2 

Pn-1 of the functions (5jy [7r(zQ,)iI'] belong to the smooth submodule $^(7r) of C°°(iV„_i\P„_i, 6*), 

which still satisfies the hypothesis of the statement. 

Hence, by induction hypothesis, the function Z? is a sum of functions of the form 



n h,,kSl/'^, • • • Slj[\zk)vF{zkr'''<j>',{z,) 



fe=i 

for ik between 1 and r^, null or positive integers or integer vectors m^, and functions (jj'f, in 
C-(Lze(Z,)). 

Now, call p the projection W' H> {6j W^')|p„-i from 7r(o) to tt^^^ then for any a in Z„_i, one 

has p{a)p{Ei) = J^t^i ^H'^)k.iPi^k)- Hence as p{a)p{Ei) equals S^ (a)7r(o)(a)£^;, we deduce 
that there is a punctured neighbourhood of zero in Z„_i, such that for each /, the function 
S^ (a)7r(o)(a)£^; — '^l^i M{a)k.iEk vanishes on elements g — pac of Gn-i [p in P„-i, a in 
Z„_i, c in Gn-iiOp)) such that a is in this neighbourhood. 
In particular, there exists Na such that for every (zi, . . . , z„_i), the vector function 

'^;7„ (")^(o) (a)-E(zi, . . . , z„_i) -*M(a)£;(zi, . . . , z„_i) 

vanishes when we have |z„_i|i? < g^ ". 

This implies, as in the proof of Proposition 2.6. of jC-P| . the following claim: 

Claim. There is actually an M" , such that for every z in Z^-x, with |z„_i|i? < qp , and every 
a in Zn-i, with \a\p < 1, the function E{zi, . . . ,z„_ia) is equal to 6jj {aYM{a)E((zi, . . . ,z„_i). 
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Proof of the claim. We denote (zi, . . . , 2^-2) by x, and z„_i by z. 

If U is an open compact subgroup of Z„_i(Di?), such that E and the homoinorphisin a G ^„-i ^-> 
M(a) G Gq(C) are [/ invariant, we denote by ui, . . . ,Us the representatives of Z„_i(Di?)/t/, and 
by w, the canonical generator of Z„_i/Z„_i(Df)- We put M" = max^ j- ( AT^ . , A'^). 

Then for z in {z G ^n-i, |z|f ^ Qp }, and a = ui^UiU in {z G ^n-i, |z|f < 1} (with w in t/, 
and r G N), we have 

i?(x,za) = E{x,zuj''u,) = (5^(^^(u,)*M(u,)i?(a;,zw'^) 

because zw'' belongs to {z G Zn-i, \z\f ^ Qp } C {z G Zn-i, \z\p < qp "'}. But if r > 1, 
again one has 

E{x,ZLo'') = dlj{f{ujYM{u){ij,)E{x,zu'^-^), 

and zuj^~^ belongs to 

{z G Z„_i, \z\p < qp^^} C {z G Zn-i, \z\p < qp^^}, 
and repeating this step, we deduce the equality E{x, za) = 5jj {ayM{a)E{x, z). D 

Hence there is an element zq in Z„_i with \zq\p = qp , such that for every (zi, . . . , z„_2) 
in Zi X ■ ■ • X Z„_2, the vector E{zi, . . . , Zn-i) is equal to 

,S^f (z„_i)*M(z„_i)(z„_i)[(5^y'(zo)*M(zo-^)]^(zi, . . . , z„_2, 20) 

for any z„_i with |z„_i|i? < 1. 

Hence the function l{|2^_j|<i}S'(zi, . . . , z„_i) is equal to 

(Xl, . . . ,Xq)*M(z„_l)(z„_l)[(5^y^(2o)*M(2cr^)]£^(2l, . . . , Z„_2, Zo)(5^;f (z„_l)l{ |^,,_j | <i} . 

One proves as for the function D, that function l{|2^_j|>i}(z„_i)S'(zi, . . . , z„„i) is of the form 

y^ S'(zi, . . . , z„_2, z^)(5^'J(z„_i)S'^(z„_i) 

with 5;3 in C^{F) for some finite set B. 

— 1/2 ~ 

By induction hypothesis again, applied to the function {Sfj Ei){zi, . . . , z„_2, -^o) a-nd the func- 

— 1/2 

tion [dfj S){zi, . . . , z„_2, Z/j), we deduce that the function S — l{|z„_i|<i}S' + l{|2„_i|>i}5' is a 
sum of functions of the form Hfc^i Cifc,„-fc(zfe)5^(^^ . . . S^^ {zk)vp{zk)"^'^ (l)'^{zk) for ik between 1 
and Tfe; null or positive integers or integer vectors ?nj^', and functions (j)'^ in C^{F). 
The statement follows as the function W equals D + S. D 

3 Lp'{ZnNn\Gn) and discrete series 

First we characterise the Whittaker functions which belong to /^ >p |VF(p)p(ip in terms of 
exponents of the "shifted derivatives" (see JBJ, 7.2.). This result has been used in [M] . 
We say that a character of a F* is positive if its (complex) absolute value, is of the form | Yp for 
some positive real r. 

Theorem 3.1. Let 6 be a nondegenerate character of the group Nn, and n be a 9-generic rep- 
resentation of Gn, let the ci_„_fc, . . . , c^^.n-fc be the characters of Zk appearing in a composition 
series of t = tt'"^ '. Then the integral 

[ \W{p)fdp 



converges for any W in t: if and only if all the characters Ci^_,k5jj are positive for k between 1 
and n — 1. 
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Proof. Again we prove the stronger statement: 

. Let (tt, V) be a Pn-submodule of C°°{Nn\Pn, 0), such that for every k between 1 and n — 1, the 
Gk-module t — tt'"^*^' = ^^($^)"^'^^^(7r) has a composition series such that, on each respective 
quotient, the central subgroup Z^ acts by the characters ci.„_fc, . . . ,Cr^^n~k- Then the integral 



I \W{p)\^dp 

Jn„\p„ 



'N„\P, 

converges for any W in tt if and only if all the characters c,,._fc(5[/ are positive for k between 1 
and n — 1. 

1/2 

Suppose first that all the characters Cij^^k^ij are positive. Let W belong to the space of tt, 
first we notice the equality 

W{p)\'dp= [ \W{g)\'dg. 

Now the Iwasawa decomposition reduces the convergence of this integral to that of 

\W{a)fS],l ^{a)d*a 

Using coordinates (zi, . . . , z„_i) (see Lemma II. ip of yl„_i, the function 6]^ (zi, . . . , z„_i) is 

equal to Ul=l(.^Uk+i ■ • • '5c/„-i)~^(2fc)- 

According to Theorem 12.11 the function |PF(zi, . . . ,z„_i)p is bounded by a sum of functions of 

the form 

n-l 



Y\_ \cik.k\i^k)\ci^^,k\i^])i^Uk+i ■ ■ ■ 5uJ{zk)vF{zk)"^'' <i>k{zk)- 

k=l 

Hence our integral will converge if the same is true of the integrals 

{zk)\ci^,k\^u,,izk)vF{tk)""'(t>kizk)dzi ...dzn, 






i.e. if the integrals /^^ \ci^,k\{zk)\ci^,k\{zk)Su„{zk)vF{tky"'''4'k{tk)dzk converge for any k between 

1 and n — 1. 

But the restriction of du„ to Z^ is equal to Su^^i, so the convergence follows from our assertion 

on the characters Ci^^k^ij ■ 

Conversely, suppose that every W in ttjo) belongs to the space L'^{Nn\Pn) corresponding to a 

right invariant measure on Nn\Pn- 

By Iwasawa decomposition, one gets that J^ ,p \W{p)\^dp = J^ , „ |PF (5)^^(7 is equal 

to /^ ^p, \W {ak)\'^ S^^ _ {a)d*adk which is greater than dk{U) J^ \W{a)\'^6^^_ {a)d*a for 
some compact open subgroup U fixing W. In particular the integral J^ \W {a)\'^ S^^ _ {a)d*a 
converges for any M^ in tt. 

This by Fubini's theorem and smoothness of W, implies that J^ \W {a)\'^ 6]^^ _ {a)d*a is finite 
for any W in tt. But the restriction of (5jv„_i to A„_i is equal to ^Ar„_2^c/,i-iJ ^o that the integral 
J. \W{a)\'^S^ S^ {a)d*a is finite for W in tt, which by Iwasawa decomposition again, 

implies that Jj^ > p \6^ _ W{p)\'^dp is finite. 

— 1/2 

The functions 6^ _ W belong to the space of (/)~(7r), hence by induction, all the characters 

1 /2 . . 1 /2 

Cik,k^(j are positive for k < n — 2. So we only need to check that the characters Ci„_j_„_i(5j/ 

1/2 
are positive. Suppose that one of them, ci,n-iSjj for instance, wasn't. 
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Then, taking v nonzero in \I' (tt) such that Z„_i niuhiphes v by ci_„_i, according to Proposition 

^^^^ 1/2 

I2.3l and taking W a preimage of w in tt, there is a positive integer iVa, such that Sjj {a)Tr{a)W{g) — 
ci_„_i(a)W^(g) is zero whenever for any 5 in Gn-i with |2;((7)|i? < Qp "• As in Claiin[21 this impHes 

1/2 

that there is a positive integer A^, such that W{ag) is equal to SjJ {a)ci,n~i{a)W (g) whenever 

\z{g)\F < Qf ^^"^ l*^!^ — -*■• W^ recall that M^ doesn't belong to V{Un, 1) (otherwise v would 
be zero), hence according to Proposition 12.31 there is go in G„_i with |z((7o)|f < Qp^ , such that 
W{go) is nonzero. We denote by Wq the function 7r(go)W^, and we recall that the integral 

Wo{a)\'^Sjjl__^{a)d*a = / \Wo{zi . . . Zn^i)\'^S]^'^^__^{zi . . . Zn-i)dzi ...dz„_i, 

is finite. Hence the smoothness of Wq and Fubini's theorem imply that the integral 

Wo{Zn-l)\'^S'^l_^{Zn^l)dZn-l^ / | Wq (z„-l) p(iz„_l 

Zn-l " Jz„-i 

1 /2 

is finite. But for \zn-i\F < 1; the function Wo{zn^i) is equal to S^ (zn-i)ci,n-i(^n-i)W^(3o) 

with W^(go) nonzero, hence it is square integrable at zero if and only if Su^cl „_i, thus Sj ci.„_i 
is positive. 

n 

Remark 3.1. The last proof more or less contains the following fact (which is more precisely a 

consequence of an induction, and the last step of the proof) : 

For every character Ci^,n-k appearing in a factor series of Tr^"^'^^ there is W in V, such that 

W{zk) is equal to [ci^^n-kSjj^ ^- ■ ■ 5jj^ ]{zk) near zero. Hence this family of characters is minimal 
in the sense that each of them must occur in the expansion given in Proposition 12.11 of some W 
in V. 

From this we deduce a characterization of the Whittaker functions in L^{ZnNn\Gn)- 

Corollary 3.1. Let 6 be a nondegenerate character of the group Nn, and it be a 9 -generic repre- 
sentation ofGn with unitary central character, let the ci,„_fe, . . . ,Cr^,n-fc be the central characters 
appearing in the factor series of t — tt'""'^-' . Then the integral 

I \W{g)\Hg 

Jz„N„\G„ 

converges for any W in n if and only if all the characters Oi^^k oltc positive for k between 1 and 
n — 1. 

Proof. By the Iwasawa decomposition, the integral Jz n \g \^^9)\'^'^9 converges for every W 
in W{'K,9) if and only if the /^ \W {a)\'^ 5~^^^{a)dg converges for every W in W{tt,9). 
As the character 5n„ restricts to G„-_i as Sn^^x^u^: this integral is equal to 

\6-l"w{a)\H-^l ^{a)dg. 

A^-i 

But this integral converges for any W in W{'k^ 9) if and only if so does the integral 

\5^J^W{p)\'dp 

'N„\P„ 

for any W in W{'k, 9). 

By the statement in the proof of theorem 13.11 applied io 5^ ® tt', this is the case if and only 

all the characters Ci^,k are positive for k between 1 and n — 1. 

U 
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Let P be a standard proper parabolic subgroup of G„, U its unipotent radical, and M its 
standard Levi subgroup. If (tt, V) is a smooth irreducible representation of G„, one calls cuspidal 
exponent of tt with respect to P, a character x of the center of Af such that the characteristic space 
of the Jacquet module {Vu)-^^c>o is nonzero. Denoting by A the set of simple roots {ai, . . . , ««} of 
Gn, We denote by p{«i. ■■■:»*} the standard parabolic subgroup associated with the set of positive 
roots A — {ttij, . . . jttij}, by [/{*i'-'**} its unipotent radical, by M'f'i'--^**^ its standard Levi 
subgroup, which admits as a central subgroup the product Zi-^ . . . Zi^ . 

Notice that except for case D, for {ii, . . . ,it} = {2}, where we used the notation C/2,n-2 for U^^'"^^ , 
the group U^''^ is what we already denoted by Uk,n-k before. 
We denote by Ay ■ the set 

{zjj ...Zi^e Zjj ...Zi^, \zijF < 1, and \zi^ ...z^Jf < !}• 

Theorem 4.4.6 of [C] then asserts that tt with unitary central character is a discrete series 
representation if and only if, for every standard parabolic subgroup pi'i.--.'*}^ if x is a cuspidal 
exponent of tt with respect to p{H,..,it}^ the restriction of x to A~ ^ is less than 1, or equiva- 
lently if x restricted to Z^j^ . . . Zi^ is positive. 

We also notice that for any k, the Jacquet module Vjj{i^} surjects onto Vu{ii,...,it} , and that the 
character Sjj{ii,...,it} restricts to Zi^, as Sjj{i^} , hence if % is a cuspidal exponent of tt with respect 
to p{»i.---.*t}^ then x\Zi is the restriction to Zi^, of a cuspidal exponent of n with respect to P't*'=h 
This implies that n irreducible with unitary central character is a discrete series representation if 
and only if the cuspidal exponents of tt with respect to maximal parabolic subgroups P^^''^ have 
positive restriction to Zi^, . 

We call a character x of Zk such that (T^^"^'^'')^ (or equivalently {V'^"'^''^)^^oo) is nonzero an 
exponent of the derivative (7r("^'^), y("^'^)). Now we recall that we showed in Proposition 12.71 
that the Zk modules Vu^. ^_^ and ]/("~'^) have the same nonzero weight subspaces. This allows 
to prove in our four cases the following conjecture of Lapid and Mao (|L^M], conjecture 3.5). 

Theorem 3.2. Let tt be a generic representation of Gn with unitary central character and with 
Whittaker model W{tt^6), then the following statements are equivalent: 

i) The integral 

\W{g)\^dg 



lN„Z„\G„ 

converges for any W in W{tt, 9). 
ii) All the exponents of the derivatives of tt are positive. 
Hi) the representation tt is square-integrable. 

Proof. By assumption, the exponents of the derivatives of tt are the characters Ci^^k of corollary 

13. IL hence i) <=> ii) is corollarv l3.1l 

ii) <^ iii): we treat the case D separately, so assume first that G„ is not GS0{2{n — 1), F). 

By Proposition 12.61 every cuspidal exponent of tt corresponding to Vu{k} is positive if and only 

if every exponent of the derivative Tr'-"^'^^ is positive. But we have already seen that this implies 

that TT is a discrete series representation. 

For the case D, we could have reversed the roles of the roots ai and a2 (which correspond to 

the two symmetric roots at the end of the Dynkin diagram). The only effect it would have is 

to change the definition of the derivative functors tt*^""^^ and tt^"~^\ Indeed U2 would become 

Ua2 J Zi and Z2 would be exchanged. The character 63 would have to be trivial on Ua^ instead 

of being trivial on Uai . But i) and ii) would still be equivalent in this case, and i) is independent 

of these choices. 

In both cases, the maps Ik from Vu^ „_^ to y("^'^) take nonzero weight subspaces to nonzero 

weight subspaces. For n > 3, the space Vuf.^_^. is equal to V^{fc}. In the first case, Vui„_^-i is 
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equal to V^{i} — Vjj^ , and it is equal to Vjj{2} ~ Vij^ in the second case. This implies that all 
the exponents of the derivatives of tt are positive if and only if all cuspidal exponents of tt with 
respect to maximal parabolic subgroups are positive. Again this proves ii) <=> iii). D 
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